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ABSTRACT 

We discuss in detail two recently proposed relations between the Parrondo's games and the Fokker-Planck 
equation describing the flashing ratchet as the overdamped motion of a particle in a potential landscape. In 
both cases it is possible to relate exactly the probabilities of the games to the potential in which the overdamped 
particle moves. We will discuss under which conditions current-less potentials correspond to fair games and vice 
versa. 
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1. INTRODUCTION 

The Parrondo's Paradox^"'^ is a combination of games inspired by the mechanism of Brownian ratchets^ and, 
more specifically, by the flashing ratchet^' ^ which shows that it is possible to use fluctuations (in the form of 
noise) to obtain directed motion in the absence of any systematic macroscopic forces -or gradients-. The physical 
picture of a flashing ratchet consists of a Brownian particle under the influence of a potential that is turned 
'on' and 'off' either periodically or stochastically. Parrondo's paradox "translates" this physical mechanism by 
considering very simple losing -or fair- gambling games, whose alternation results in a winning game. In the 
original, and still the simplest version, one considers a player which tosses biased coins, such that one unit of 
"capital" is won (lost) if heads (tails) show up. Two games are combined. The first game, game A, is such 
that there is the same probability of winning independently of the capital of the player: pi = 5 j Vi , where i 
denotes the actual capital of the player. The second game, game B, has probabilities which depend on whether 
the capital i of the player is or not a multiple of 3, 
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if mod{i, 3) = 

(1) 

if mod{i, 3) ^ 

It is easy to show that both games A and B are fair games ("Parrondo" games), while the alternation (either 
random or periodic) of both games produces a winning game. Many other extensions of the games have been 
proposed, including a version with probabilities depending on the outcome of the previous games^ , collective 
players^' ^ , quantum games^" , Ising systems^^ , pattern formation^^ . 

Although, as stated before, Parrondo's games were inspired by the flashing ratchet, there was not a direct and 
precise connection between both, but only qualitative arguments. It has been only very recently that the work 
by Allison and Abbott ^'^ has established a quantitative relation between the physical parameters (potential) of 
the flashing ratchet and the probabilities of Parrondo's games, by discretizing conveniently the Fokker-Planck 
equation for the flashing ratchet and comparing it afterwards with the master equation for the games. An 
alternative relation has been put forward by us^** using a somewhat different approach in which we identify the 
current directly in the master equation and then compare it with an ad hoc discretization of the Fokker-Planck 
equation. In both cases it is possible to relate precisely the probabilities defining the games with the values of a 
discretized version of the physical potential that represents the ratchet. 
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In this paper we will study in detail the results given by the two proposed relations, references ' , between 
the games and the ratchets and we will give explicit results concerning these relations and, in particular, the 
finding of a suitable potential for the description of the games. The paper is organized as follows: in the next 
section we review the proposed relations between the games and the ratchets and write down the equivalence 
between the physical parameters of a ratchet and the games probabilities. We work in both directions: first, 
given the probabilities of the Parrondo's games, we obtain the Brownian particle potential; second, from a given 
potential, we extract the corresponding probabilities. In section 3 we give specific examples using the original 
version of the games and a widely used ratchet potential. Some technical problems appearing for an even number 
of discretization points in our formalism are discussed in section 4. Finally, section 5 briefly summarizes the 
main results. 



2. RELATION BETWEEN THE FOKKER-PLANCK AND MASTER EQUATIONS 

The first connection is that proposed by Allison and Abbott -"^"^ which we now review very briefly. These authors 
start by considering the following general Fokker-Planck equation^® for the probability P{z, t) of a Brownian 
particle moving in a time-dependent one- dimensional potential V{z, t) 

B'^P Ba dP dP „ 

here a and D are referred to as the infinitesimal first and second moments of diffusion, respectively; D is 
considered to take a constant value -"Pick's law constant"- D w 1.3 x 10~^ rn^s~^ while a{z,t) is a function 
related to the applied potential V{z, t) by 

a{z,t) = -u-^V{z,t), (3) 
u denotes the mobility of the Brownian particle given by 

51.9 X lO-^m^s"^ (4) 



where accounts for the electrical charge on the particle, 77 is the kinematic viscosity of the solvent and a is 
the effective radius of the particle. The next step is to discretize Eq. (2) using a finite difference approximation 
to obtain: 

Pi,j = (i-i ■ Pi-i,j-i + ■ Pi,j-i + a+'i • Pi+ij-i (5) 

where 

Dt I ct(i,j)r 
J'i = 2A 

-1 a(»+l,j-l)-a(i-l,3-l) ^ I ^ 
2 A 

—iHj^ a- 1 

"0 a(»+l,j-l)-a(»-l,j-l) _ , 1 V'; 

2A T ^ L 

Dt _ ce{hj)r 

^i,3 _ 2X (o\ 

+1 a{i+l,j-l)-a(i-l,j-l) ^ , , 
2A T ^ 1 

Index i denotes the discretized space, z = iX, whereas j denotes the discretized time, t = jr, being A and 
r, respectively, the space and time discretization steps. Therefore Pij stands for P{iX,jT), a{i,j) stands for 
a(iX,jT) and similar relations between the continuum and discretized version of other functions. 

This discretized form (5) of the Fokker-Planck equation is compared to a general master equation for any of 
the gambling games used in the Parrondo's paradox. This general master equation is 

Pi,j = Pi-i ■ Pi-i,j-i + Qi ■ Pi,j-i + (1 - Pi+i - Qi+i) ■ Pi+i,j-i (9) 

where Pij denotes the probability that the player has a capital i at the j tossing of the coin. In this way, the 
time t of the Brownian particle becomes the number j of tossed coins and the position z becomes the value of 



the capital i. In this general master equation pi is the probability of winning given that the value of the capital 
is i, and qi is the probability of remaining the same (neither losing nor winning) given that the value of the 

capital is z. In accordance with the rules of the Parrondo games we will set qi = since at each tossing of the 
coins the capital increases or decreases, but never remains the same. Notice that, in accordance again with the 
rules of the Parrondo's games, we are assuming that the probabilities pi do not depend on time (the index j). 
This implies that the discretized version of the first moment of diffusion a(z,t) does not depend on the index 
j either, a{z,t) a^. Moreover, the probabilities must satisfy Pi+L = Pi for a given L (L = 3 in the original 
version of the games). 

Combining equation (5) and equation (9) we get 



Pi-i _ a-i _ 1 + 2m^ai 



1-Pi+i a+i i-^ai 
from where it can be obtained an expression for a. 



(10) 



A pi-i + [1 - pi+i) 

Finally, the discretized values of the potential are obtained by using a convenient discretization of Eq. (3), 
namely: 



Ziy \ ^ ^ Pk-1 ' 
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This fundamental relation allows one to obtain the discretized version of the physical potential Vi in terms of the 
probabilities pi of the games. It is possible to invert it to find the Pi in terms of the V^. If one wants to recover 
a Parrondo- type game, the inverse equations need to be solved under the condition that Pi+z, = Pi for a suitable 
value of L. For the case of L=3 we obtain the following expressions for the pi: 

(-1 + K( - v[){-\ + + y{ + 3-K(K - vj - -sv^vi) 
2{-i + v'l-v^v; + v'l-v(v^) 

(-1 + SV'l + V( - V^i2 + 3y/))(-l + V{ - Vj) 

2(-l + V'l - V^V{ + V'l - ViVi) 
(1 + ^00(1 - + 2Vl + - W'l - Vj - W^i + WlVj) 

2{-l + V'l-V^Vi + V'\-ViVi) ^ ' 

where Vl = ~^V, . 

A second connection between the Fokker-Planck equation and the master equation is given by our treatment 
in reference"^^ (see also reference^"''). Our approach to this problem is, in some sense, complementary to that of 
reference^^ since our starting point is not the Fokker-Planck equation but rather the master equation (9) which 
we write in the form: 

Pi,o = a!_iPi-ij_i + + aiPi+ij_i (14) 

where a^_i is the probability of winning when the capital is i — 1, a\ is the probability of losing when the capital is 
i + 1, and af, is the probability that the capital i remains unchanged (a possibility not considered in the original 
Parrondo games). To ensure the conservation of probability (^ - Pij = Pi,j-i) the coefficients a, must satisfy 



= 1 (15) 



Replacing this equation in (14) it is possible to write the master equation in the form of a continuity equation 
for the probability 

Pi,i - PiJ-i = - [Ji+hj - Aj] (16) 



where the current Ji^j is given by: 



Ji 



1,] 



[FiPi,i + -Fj-l-Pi-lj] — [A-Pi,j — A-l-Pj-lj] 



and 
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(a!_Y+ar^) 



(17) 



(18) 



We can relate the previous coefficients (18) with their analogous terms corresponding to a discretization of the 
Fokker-Planck equation for a probabihty P{x,t) 



dP{x,t) dJ{x,t) 



with a current 



dt 



J{x,t) = Fix)P{x,t) 



dx 

d[D{x)P{x,t)] 

dx 



(19) 
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with general drift, F{x), and diffusion, D{x). If r and A are, respectively, the time and space discretization 
steps, such that x = iX and t = jr, it is clear the identification 



Considering the case ag = and since Pi = a^J^^ we have 

Di = D = 1/2 



Fi = -1 + 2pi 



(21) 



(22) 



and the current takes the following form : Jij = —(1 — Pi)Pij + pi-iPi-ij . The latter expression is nothing 
but the probability flux from site i — 1 to site i. We now define a potential Vi in terms of Fi, or, equivalently, Pi 



1 + Fk-i 
1-Fk 



1 ' 



Pk-l 



(23) 



we have adopted the, otherwise arbitrary, value Vq = 0. This equation is our main result concerning the relation 
between the games probabilities pi and the discretized version of the potential Vi. In the next section we will 

compare both expressions (12) and (23). 

We can obtain the stationary probability distribution P/* through the recurrence relation derived from equa- 
tion (17) using a constant current Ji = J, together with the boundary condition Pf* = Pf^i^- The result 
is: 



Pf = Ne 



-2Vi 



2 J \ ^ I 

iv ^ T 



and a current 



-2\: 



J = N- 



^Z^j=l 1-Fj 



N is nothing but a normalization constant obtained with X)f=o^ ~ ^- interesting to note that this 

expression for the current coincides in the case L = 3 with the known formula^^: 

P0P1P2 - (1 -po)(l -Pi)(l -P2) 



(24) 



(25) 
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2+P0P1P2 - (1 -Po)(l -Pi)(l -P2)) 



(26) 



The inverse problem of obtaining the game probabilities in terms of the potential requires solving Eq. (23) 
with the boundary condition Fq = Fl- For that purpose we must solve the following set of equations: 



Fi+i = 1 - e^* - Fie^' 



(27) 



where = Vi+i — Vi. We recall first that the general solution of the set of recurrence relations: 

Xi = ai + bi- Xi-i i = 0, 1, . . . 



with initial condition xq is 



Identifying in Eq. (27): 



and 



j=l k=j+l 



k=l 



a,i = 1 — e 



1 - e 



Vi-Vi- 



we arrive at the following expression 
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(29) 



(30) 



(31) 



(32) 



which, via pi = {\ + Fi)/2, allows one to obtain the probabilities pi in terms of the potential Vi. It is clear that 
the additional condition pi G [0, 1], Vi must be fulfilled by any acceptable solution. 

Summing up, given a set of probabilities [pq, . . . ,pl-i) defining a Parrondo game, there are two possibilities 
for the stochastic potential Vi, using either Eq. (12) or Eq.(23). From any one of these, the inverse problem 
can be solved in order to find the probabilities given a stochastic potential. In the next section we give explicit 
examples of these procedures. 



3. EXAMPLES 

Wc use the game B defined by Eq.(l). This is equivalent to take L = 3 and = 1/10, pi = P2 = 3/4 
supplemented by PiJ^z = Pi- The stochastic potential derived using (12) is plotted in figure 1. It is clear that 
this potential is not periodic. Therefore, it is the discretized version of a nonperiodic continuum potential V{z). 
The potential tilt, in the continuum case, will induce a non-zero current. This is in contrast with the condition 
of fairness for game B which implies that there is no net gain when playing that game. Instead, this kind of 
potential would be characteristic of an unfair game with a current J to the left, i.e. a losing game. 

If wc use Eq.(23) instead we obtain the following values for the discretized potential Vq = 0, = In (|) , V2 = 
In (I) together with the periodicity condition 1^+3 = V^. Notice that this periodicity condition is equivalent to 

= (1 - Po)(l - Pi)(l - P2) (33) 

which is the condition of B being a fair game. In fact, the general condition for a fair game can be obtained 
through the discrete time Markov chain analysis as^ 

L-l L-1 

J{vi=J{{l-Vi) 

i=0 i=0 

which is automatically fulfilled by (23) for periodic potentials Vi = Vi+L- 

The resulting values of this potential are plotted in figure 2. In this case, we note that the potential can be 
thought of as the discretized version of a null current continuous potential. 



(34) 
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Figure 1. Potential Vi derived from the original Parrondo game B, Eq. (1) using the relation between the potential and 
the probabilities given by Eq.(12). 
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Figure 2. Similar to figure 1 using instead relation between the potential and the probabilities given by Eq.(23). 



We now turn to the inverse problem: given the discretized version of the potential , Vi , obtain the corre- 
sponding probabilities using Eqs. (13) or (32). We consider the widely used ratchet potential^ V{x): 



V{x) 



sin {2ttx) + - sin (4 tt x) 



(35) 



with an amplitude A = 0.01. Wc discrctizc it by using A = 1/3 such that there are L = 3 points per period and 
Vi = V{iX).We obtain the following sets of probabilities. Using equation (13): 



Po = 0.567082 

pi = 0.736037 

P2 = 0.263963. 

Using (26) these values yield a current J = 0.0118792. 
Using equation (32) we obtain instead 

Po = 0.493504 

pi = 0.503279 

P2 = 0.503216. 



(36) 



(37) 



In this case the current is J = as it corresponds to a fair game. 



4. THE CASE OF L EVEN 



A problem arises when finding the probabilities pi using (32) for a periodic potential (corresponding to a fair 
game) when the number of points L is even. This is obvious since the periodicity condition Vl = Vq gives a zero 



value for the denominator (— l)^e 



LJ2{Vo-Vl) 



1. In order to be able to find solutions for the probabilities, the 



numerator has to vanish as well. This is equivalent to the condition: 



-2V2, 



k k 

which, in terms of the stationary probabilities, becomes: 



St 

2fe+l- 



(38) 



(39) 



This condition imphes that one can have a fair game in the case of an even number L only if the probability of 
finding an even value for the capital equals that of finding an odd value. To our knowledge, this curious property, 
which emerges naturally from the relation between the potential and the probabilities, has not been reported 
previously. 

It turns out that one has to be careful when discretizing a periodic potential V{x) in order to preserve this 
property. Otherwise, there will be no equivalent Parrondo game with zero current. The simple identification 
Vi = V{i\) might not satisfy this requirement, but we have found that a possible solution is to shift the origin 
of the X-axis, i.e. setting = V{{i + 5)\) for a suitable value of 5. For example, in Fig. 3 we plot the difference 



d(<5)=^e- 



-2V{(2i+S)X) 



-2V({2i+l+S)X) 



(40) 



as a function of 5 in the case of the potential (35) and A = 1/4 (which corresponds to i = 4 points per period). 
We see that there is only one value that accomplishes d{5) = 0, namely S = —0.068616. 




Figure 3. Plot of d{S) as given by Eq. (40) versus displacement 6. The unique zero crossing is at 5 = —0.068616. 

Once the proper value of 6 is found, it follows from Eq. (32) that there are infinitely many solutions for 
the probabilities. They can be found by varying, say, po, such that for each value of po we will get a set of 
probabilities pi. Solutions satisfying the additional requirement that pi G [0, 1], Vi, will exist only for a certain 
range of values of po G [0.0025,0.68]. Some of the different solutions are plotted in figure 4. Some numerical 
values are : 



• Po= 0.125, pi = 0.8167766, p2 = 0.3927740, ps = 0.7082539 



• Po = 0.25, pi = 0.6335531, p2 = 0.5289900, p3 = 0.6070749 

• Po = 0.3525, pi = 0.4833099, p2 = 0.6406871, pa = 0.5241081 

• Po = 0.50, pi = 0.2671062, = 0.8014221, pa = 0.4047168 
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Figure 4. Multiple solutions for the probabilities pi obtained with equation (23) for a potential like (35) with A = 0.3 , 
\ — J , 5 = —0.068616 varying the value of po- The continuous line corresponds to the "optimal" solution, po = 0.3525 
(see the text). 

An additional criterion to chose between the different sets of probabilities is to impose the maximum "smooth- 
ness" in the distrbution of the pi's. For instance, one could minimized the sum '^fS^ {pi+i —PiY- In our example 
this criterion yields po = 0.3525 and the other values follow from the previous table. 

5. CONCLUSIONS 

In summary, we have compared the results given by two recently proposed relations between the master equation 
describing a Parrondo game and the Fokker-Planck equation for a ratchet. While the approach of reference [13] 
discretizcs first the Fokkcr Planck equation and then relates it to a master equation, our own approach takes 
as a starting point the master equation and then finds the ad hoc (although consistent) discretization of the 
Fokker-Planck equation that yields exactly the same master equation. We have found for the two proposals 
the potential that corresponds to a particular set of the game probabilities, as well as the probabilities that 
correspond to a a widely used ratchet potential. We have analyzed in detail the case of an even number of points 
in the discretization obtaining that for a given potential there are many possible probabilities compatible with 
it. The discretization, in this case, has to fulfill the property that the stationary probability of having an even 
value of the capital is equal to that of having an odd value. 
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